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Abstract: In most contemporary approaches to decision making, a decision problem 
is described by a sets of states and set of outcomes, and a rich set of acts, which are 
functions from states to outcomes over which the decision maker (DM) has prefer- 
ences. Most interesting decision problems, however, do not come with a state space 
and an outcome space. Indeed, in complex problems it is often far from clear what 
the state and outcome spaces would be. We present an alternative foundation for 
decision making, in which the primitive objects of choice are syntactic programs. A 
representation theorem is proved in the spirit of standard representation theorems, 
showing that if the DM's preference relation on objects of choice satisfies appropriate 
axioms, then there exist a set S of states, a set O of outcomes, a way of interpreting 
the objects of choice as functions from 5 to O, a probability on S, and a utility function 
on O, such that the DM prefers choice a to choice b if and only if the expected utility 
of a is higher than that of b. Thus, the state space and outcome space are subjective, 
just like the probability and utility; they are not part of the description of the problem. 
In principle, a modeler can test for SEU behavior without having access to states or 
outcomes. We illustrate the power of our approach by showing that it can capture 
decision makers who are subject to framing effects. 
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In memoriam Karl Vind. 



1 Introduction 

Most models of decisionmaking under uncertainty describe a decision environment 
with a set of states and a set of outcomes. Objects of choice are acts, functions 
from states to outcomes. The decision maker (DM) holds a preference relation on 
the set of all such functions. Representation theorems characterize those prefer- 
ence relations with utility functions on acts that separate (more or less) tastes on 
outcomes from beliefs on states. The canonical example is Savage's (1954) charac- 
terization of those preference relations that have a subjective expected utility (SEU) 
representation: Acts are ranked by the expectation of a utility payoff on their out- 
comes with respect to a probability distribution on states. Choquet expected utility 
(Schmeidler 1 989) maintains the separation between tastes and beliefs, but does not 
require that beliefs be represented by an additive measure. Tversky and Kahneman's 
(1992) cumulative prospect theory relaxes the taste-belief separation by assessing 
gains and losses with different belief measures; Wakker and Tversky (1993) discuss 
generalizations of SEU from this point of view. Modern attempts to represent am- 
biguity in choice theory relax both the meaning of likelihood and the separation of 
tastes and beliefs that characterize SEU. All of these generalizations of SEU, how- 
ever, maintain the state-outcome-act description of objects of choice and, moreover, 
take this description of choice problems as being given prior to the consideration of 
any preference notion. 

We, on the other hand, follow Ellsberg (2001) in locating the source of am- 
biguity in the description of the problem. For Savage (1954, p. 9), the world is 'the 
object about which the person is concerned' and a state of the world is 'a description 
of the world, leaving no relevant aspect undescribed.' But what are the 'relevant' de- 
scriptors of the world? Choices do not come equipped with states. Instead they are 
typically objects described by their manner of realization, such as 'buy 100 shares of 
IBM' or 'leave the money in the bank,' 'attack Iraq,' or 'continue to negotiate.' In Sav- 
age's account (1 954, sec. 2.3) it is clear that the DM 'constructs the states' in contem- 
plating the decision problem. In fact, his discussion of the rotten egg foreshadows this 
process. Subsequently, traditional decision theory has come to assume that states 
are given as part of the description of the decision problem. We suppose instead that 
states are constructed by the DM in the course of deliberating about questions such 
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as 'How is choice A different from choice B7' and 'In what circumstances will choice 
A turn out better than choice B?'. These same considerations apply (although here 
Savage may disagree) to outcomes. This point has been forcefully made by Weibull 
(2004). 

There are numerous papers in the literature that raise issues with the state- 
space approach of Savage or that derive a subjective state space. Machina (2006) 
surveys the standard approach and illustrates many difficulties with the theory and 
with its uses. These difficulties include the ubiquitous ambiguity over whether the 
theory is meant to be descriptive or normative, whether states are exogenous or con- 
structed by the DM, whether states are external to the DM, and whether they are 
measurable or not. Kreps (1992) and Dekel, Lipman, and Rustichini (2001) use a 
menu choice model to deal with unforeseen contingencies — an inability of the DM to 
list all possible states of the world. They derive a subjective state space that repre- 
sents possible preference orders over elements of the menu chosen by the DM. Ghi- 
rardato (2001) takes an alternative approach to unforeseen contingencies and mod- 
els acts as correspondences from a state space to outcomes. Gilboa and Schmeidler 
(2004) and Kami (2006) raise objections to the state space that are similar to ours 
and develop decision theories without a state space. Both papers derive subjective 
probabilities directly on outcomes. Ahn (2007) also develops a theory without a state 
space; in his theory, the DM chooses over sets of lotteries over consequences. Ahn 
and Ergin (2007) allow for the possibility that there may be different descriptions of a 
particular event, and use this possibility to capture framing. For them, a 'description' 
is a partition of the state space. They provide an axiomatic foundation for decision 
making in this framework, built on Tversky and Koehler's (1994) notion of support 
theory. 

Our approach differs significantly from these mentioned above. The inspira- 
tion for our approach is the observation that objects of choice in an uncertain world 
have some structure to them. Individuals choose among some simple actions: 'buy 
100 shares of IBM' or 'attack Iraq'. But they also perform various tests on the world 
and make choices contingent upon the outcome of these tests: 'If the stock broker 
recommends buying IBM, then buy 100 shares of IBM; otherwise buy 100 shares of 
Google.' These tests are written in a fixed language (which we assume is part of the 
description of the decision problem, just as Savage assumed that states were part of 
the description of the decision problem). The language is how the DM describes the 
world. We formalize this viewpoint by taking the objects of choice to be (syntactic) 
programs in a programming language. 
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The programming language is very simple — we use it just to illustrate our 
ideas. Critically, it includes tests (in the context of if ...then ...else statements). 
These tests involve syntactic descriptions of the events in the world, and allow us to 
distinguish events from (syntactic) descriptions of events. In particular, there can be 
two different descriptions that, intuitively, describe the same event from the point of 
view of the modeler but may describe different events from the point of view of the 
decision maker. Among other things, this enables us to capture framing effects in our 
framework, without requiring states as Ahn and Ergin (2007) do, and provides a way 
of dealing with resource-bounded reasoners. 

In general, we do not include outcomes as part of the description of the deci- 
sion problem; both states and outcomes are part of the DM's (subjective) represen- 
tation of the problem. We assume that the DM has a weak preference relation on the 
objects of choice; we do not require the preference relation to be complete. The set 
of acts for a decision problem is potentially huge, and may contain acts that will never 
be considered by the DM. While we believe that empirical validity requires consider- 
ing partial orders, there are also theoretical reasons for considering partial orders. 
Our representation theorems for partial orders require a set of probabilities and utility 
functions (where often one of the sets can be taken to be a singleton). Schmeidler 
(1989, p. 572) observes that using a set of probability distributions can be taken as 
a measure of a DM's lack of confidence in her likelihood assessments. Similarly, a 
set of utilities can be interpreted as a lack of confidence in her taste assessments 
(perhaps because she has not had time to think them through carefully). 

The rest of this paper is organized as follows. We begin the next section with 
a description of the syntactic programs that we take as our objects of choice, discuss 
several interpretations of the model, and show how syntactic programs can be inter- 
preted as Savage acts. In Section 3, we present our assumptions on preferences 
The key postulate is an analogue of Krantz et al.'s (1971) cancellation axiom. In Sec- 
tion 4 we present our representation theorems for decision problems with subjective 
outcomes and those with objective outcomes. Section 5 discusses how our frame- 
work can model boundedly rational reasoning. In Section 6 we discuss how updating 
works for new information about the external world as well as for new information 
about preferences. Section 7 concludes. 
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2 Describing Choices 

We begin by describing the language of tests, and then use this language to con- 
struct our syntactic objects of choice. We then use the language of tests to describe 
theories of the world. We show how framing problems can be understood as 'odd' 
theories held by decision makers. 



2.1 Languages for tests and choices 

A primitive test is a yes/no question about the world, such as, 'IBM's price-earnings 
ratio is 5', 'the economy will be strong next year' and 'the moon is in the seventh 
house'. We assume a finite set Tq of primitive tests. The set T of tests is constructed 
by closing the set of primitive tests under conjunction and negation. That is, T is the 
smallest set such that To C T, and if ti and t2 are in T, so is ti A t2 and -^ti. Thus, 
the language of tests is just a prepositional logic whose atomic propositions are the 
elements of Tq. 

We consider two languages for choices. In both cases, we begin with a finite 
set ^0 of primitive cinoices. These may be objects such as 'buy 100 shares of IBM' 
or 'buy $10,000 worth of bonds'. The interpretation of these acts is tightly bound to 
the decision problem being modeled. The first language simply closes off under 
if . . . then . . . else. By this we mean that if t is a test in T and a and h are choices 
in A, then if t tlien a else h is also a choice in A. When we need to be clear about 
which To and Aq were used to construct A, we will write ^^o,to- Note that A allows 
nesting, so that if ti then a else (if t2 then h else c) is also a choice. 

The second languages closes off with if . . .then . . .else and randomiza- 
tion. That is, we assume that objective probabilities are available, and require that 
for any < r < 1, if a and h axe choices, so is ra + (1 — r)h. Randomization and if 
. . . then . . . else can be nested in arbitrary fashion. We call this language ^+ {^\o,To 
when necessary). 

Tests in T are elements of discourse about the world. They could be events 
upon which choice is contingent: If the noon price of Google stock today is below 
$600, then buy 100 shares, else buy none. More generally, tests in T are part of the 
DM's description of the decision problem, just as states are part of the description 
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of the decision problem in Savage's framework. However, elements of T need not 
be complete descriptions of the relevant world, and therefore may not correspond to 
Savage's states. When we construct state spaces, elements of T will clearly play a 
role in defining states, but, for some of our representation theorems, states cannot 
be constructed out of elements of T alone. Additional information in states is needed 
for both incompleteness of preferences and when the outcome space is taken to be 
objective or exogenously given. 

The choices in A and A'^ are syntactic objects; strings of symbols. They 
can be given semantics — that is, they can be interpreted — in a number of ways. For 
most of this paper we focus on one particular way of interpreting them that lets us 
connect them to Savage acts, but we believe that other semantic approaches will 
also prove useful (see Section [7). The first step in viewing choices as Savage acts is 
to construct a state space S, and to interpret the tests as events (subsets of S). With 
this semantics for tests, we can then construct, for the state space S and a given 
outcome space O, a function pso that associates with each choice a a Savage act 
Pso{a), that is, a function from S to O. Given a state space S, these constructions 
work as follows: 

Definition 1 . A test interpretation vr^ for the state space S is a function associating 
witii eacfi test a subset of S. An interpretation is standard // it interprets and A in 
thie usual way; thiat is 

• 7rs(ti Ats) = 7r5(ti) n 7rs(t2) 
. Tisi^t) = S - ns{t). 

Intuitively, irsit) is the set of states where t is true. We will allow for nonstandard in- 
terpretations. These are interpretations in which, for some test t, there may be some 
state where neither t nor -^t is true; that is, there may be some state in neither nsit) 
nor TVsi^t)); similarly, there may be some state where both t and -it are true. Such 
nonstandard interpretations are essentially what philosophers call 'impossible possi- 
ble worlds' (Rantala 1982); they have also been used in game theory for modeling 
resource-bounded reasoning (Lipman 1999). A standard interpretation is completely 
determined by its behavior on primitive tests. This is not true of nonstandard inter- 
pretations. All test interpretations are assumed to be standard until Section [51 There 
we motivate nonstandard interpretations, and show how our results can be modified 
to hold even with them. 
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Definition 2. A choice interpretation pso for the state space S and outcome space 
O assigns to each choice a e Aa (Savage) act, that is, a function pso{o) ■ S ^ O. 

Choice interpretations are constructed as follows: Let p'gQ : O'^ be a choice 

interpretation for primitive choices, which assigns to each Oo G A a function from 
S ^ O.VJe extend p'gQ to a function mapping all choices in A to functions from S to 
O by induction on structure, by defining 

/■i.xu I \f \ f Pso{ai){s) iiseiTsit) ... 

P5o(.ftthena,elsea,)(.) = | ^^^J^^jJ^j ifs^vr,(t). 

This semantics captures the idea of contingent choices; that, in the choice if t then 
ai else 02, the realization of ai is contingent upon t, while a-j is contingent upon 'not 
t'. Of course, ai and 02 could themselves be compound acts. 

Extending the semantics to the language A'^, given S, O, and ns, requires 
us to associate with each choice a an Anscombe-Aumann (AA) act (Anscombe and 
Aumann 1963), that is, a function from S to probability measures on O. Let A(0) 
denote the set of probability measures on O and let A*(0) be the subset of A(0) 
consisting of the probability measures that put probability one on an outcome. Let 
P50 • -^0 A*{0)^ be a choice interpretation for primitive choices that assigns to 
each Oo e ^0 a function from S — > A*(0). Now we can extend p^p by induction on 
structure to all of A'^ in the obvious way. For if . . . then . . . else choices we use ([1); 
to deal with randomization, define 

pso{rai + (1 - r)a2){s) = rpso{ai){s) + (1 - r)pso{a2){s). 

That is, the distribution pso{rai + (1 - r)a2)(s) is the obvious mixture of the dis- 
tributions pso{ai){s) and pso{a2){s). Note that we require pso to associate with 
each primitive choice in each state a single outcome (technically, a distribution that 
assigns probability 1 to a single outcome), rather than an arbitrary distribution over 
outcomes. So primitive choices are interpreted as Savage acts, and more general 
choices, which are formed by taking objective mixtures of choices, are interpreted as 
AA acts. This choice is largely a matter of taste. We would get similar representation 
theorems even if we allowed to be an arbitrary function from A to A{0)^. How- 
ever, this choice does matter for our interpretation of the results; see Example pMlfor 
further discussion of this issue. 
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2.2 Framing and equivalence 

Framing problems appear when a DM solves inconsistently two decision problems 
that are designed by the modeler to be equivalent or that are obviously similar after 
recognizing an equivalence. The fact that choices are syntactic objects allows us to 
capture framing effects. 

Example 1 . Consider the following well-known example of the effects of framing, due 
to McNeil et al. (1982). DMs are asked to choose between surgery or radiation 
therapy as a treatment for lung cancer. The problem is framed in two ways. In the 
what is called the survival frame, DMs are told that, of 1 00 people having surgery, 90 
live through the post-operative period, 68 are alive at the end of the first year, and 34 
are alive at the end of five years; and of 100 people have radiation therapy, all live 
through the treatment, 77 are alive at the end of the first year, and 22 are alive at 
the end of five years. In the mortality frame, DMs are told that of 1 00 people having 
surgery, 10 die during the post-operative period, 32 die by the end of the first year, 
and 66 die by the end of five years; and of 1 00 people having radiation therapy, none 
die during the treatment, 23 die by the end of the first year, and 78 die by the end of 
five years. Inspection shows that the outcomes are equivalent in the two frames — 90 
of 100 people living is the same as 10 out of 100 dying, and so on. Although one 
might have expected the two groups to respond to the data in similar fashion, this was 
not the case. While only 18% of DMs prefer radiation therapy in the survival frame, 
the number goes up to 44% in the mortality frame. 

We can represent this example in our framework as follows. We assume that 
we have the following tests: 

• RT, which intuitively represents '100 people have radiation therapy'; 

• S, which intuitively represents '100 people have surgery'; 

• Li{k), for z = 0, 1, 5 and k = 0,. . . , 100, which intuitively represents that k out 
of 100 people live through the post-operative period (if i = 0), are alive after 
the first year (if i = 1), and are alive after five years (if i = 5); 

• Di{k), for z = 0, 1, 5 and k = 0,. . . , 100, which is like Li{k), except 'live/alive' 
are replaced by 'die/dead'. 
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In addition, we assume that we have primitive programs as and an that represent 
'perform surgery' and 'perform radiation theory'. With these tests, we can character- 
ize the description of the survival frame by the following test ti. 

{S Lo(90) A Li(68) A ^5(34)) A {RT =^ Lo(lOO) A Li(77) A ^5(22)), 

(where, as usual, t ^ t' \s an abbreviation for A -^t')); similarly, the mortality 
frame is characterized by the following test 

{S Do{10) A Di{32) A £'5(66)) A {RT =^ Do{0) A Di(23) A 1^5(78)). 

The choices offered in the McNeil et al. experiment can be viewed as condi- 
tional choices: what would a DM do conditional on ti (resp., ^2) being true. Using 
ideas from Savage, we can capture the survival frame as a decision problem with the 
following two choices: 

if ti then as else a, and 
if ti then a^ else a, 

where a is an arbitrary choice. Intuitively, comparing these choices forces the DM 
to consider his preferences between as and an conditional on the test, since the 
outcome in these two choices is the same if the test does not hold. Similarly, the 
mortality frame amounts to a decision problem with the analogous choices with ti 
replaced by ^2- 

There is nothing in our framework that forces a DM to identify the tests ti and 
^2; the tests Li{k) and A(100 - A;) a priori are completely independent, even if the 
problem statement suggests that they should be equivalent. Hence there is no rea- 
son for a DM to identify the choices If ti then as else a and If t2 then as else a. As a 
consequence, as we shall see, it is perfectly consistent with our axioms that a DM has 
the preferences if ti then as else a :^ if ti then aR else a and if t2 then a^ else a >- 
if t2 then as else a. I 

We view it as a feature of our framework that it can capture this framing exam- 
ple for what we view as the right reason: the fact that DMs do not necessarily identify 
Li{k) and A(100 - k). Nevertheless, we would also like to be able to capture the 
fact that more sophisticated DMs do recognize the equivalence of these tests. We 
can do this by associating with a DM her understanding of the relationship between 
tests. For example, a sophisticated DM might understand that Li{k) A(100 - k), 
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for z = 0, 1, 5 and k = 1, . . . , 100. Formally, we add to the description of a decision 
problem a theory, that is, a set AX C T of tests. Elements of the theory are called 
axioms. 

Definition 3. A test interpretation ns for the state space S respects a theory AX iff 

for all t G AX, TXs{t) = S. 

A theory represents the DM's view of the world; those tests he takes to be axiomatic 
(in its plain sense). Different people may, however, disagree about what they take 
to be obviously true of the world. Many people will assume that the sun will rise 
tomorrow. Others, like Laplace, will consider the possibility that it will not. 

Choices a and b are equivalent with respect to a set U of test interpretations 
if, no matter what interpretation vr g n is used, they are interpreted as the same 
function. For example, in any standard interpretation, if t then a else b is equivalent 
to if -i-it then a else b; no matter what the test t and choices a and b are, these 
two choices have the same input-output semantics. The results of the McNeil et 
al. experiment discussed in Example[i|can be interpreted in our language as a failure 
by some DMs to have a theory that makes tests stated in terms of mortality data or 
survival data semantically equivalent. This then allows choices, such as the choice 
of surgery or radiation therapy given these tests, to be not seen as equivalent by 
the DM. Thus, it is not surprising that such DMs are not indifferent between these 
choices. 

Definition 4. For a set U of test interpretations, choices a and b are U-equivalent, 
denoted a =n b, if for all state spaces S, outcomes O, test interpretations ns G U, 
and choice interpretations pso, Pso{o) = Pso{b)- 

Denote by Hax the set of all standard interpretations that respect theory AX. Then 
n^x-equivalent a and b axe said to be AX-equivalent, and we write a =ax b. Note 
that equivalence is defined relative to a given set n of interpretations. Two choices 
may be equivalent with respect to the set of all standard interpretations that hold a 
particular test t to be true, but not equivalent to the larger set of all standard test 
interpretations. 



10 



3 The Axioms 

This section lays out our basic assumptions on preferences. Since our basic frame- 
work allows for preferences only on discrete sets of objects, we cannot use con- 
ventional independence axioms. Instead, we use cancellation. Cancellation axioms 
are not well known, so we use this opportunity to derive some connections between 
cancellation and more familiar preference properties. 



3.1 Preferences 

We assume that the DM has a weak preference relation ^ on a subset C of the sets 
A (resp., A^) of non-randomized (resp., randomized) acts. This weak preference 
relation has the usual interpretation of 'at least as good as'. We take a ^ 6 to be an 
abbreviation for a ^ 6 and hjha, even if ^ is not complete. We prove various rep- 
resentation theorems that depend upon the language, and upon whether outcomes 
are taken to be given or not. The engines of our analysis are various cancellation 
axioms, which are the subject of the next section. At some points in our analysis we 
consider complete preferences: 

A1. The preference relation ^ is complete. 

The completeness axiom has often been defended by the claim that 'people, in the 
end, make choices.' Nonetheless, from the outset of modern decision theory, com- 
pleteness has been regarded as a problem. Savage (1954, Section 2.6) discusses 
the difficulties involved in distinguishing between indifference and incompleteness. 
He concludes by choosing to work with the relationship he describes with the sym- 
bol ^ ■, later abbreviated as <, which he interprets as 'is not preferred to'. The 
justification of completeness for the 'is not preferred to' relationship is anti-symmetry 
of strict preference. Savage, Aumann (1962), Bewley (2002) and Mandler (2001) 
argue against completeness as a requirement of rationality. Eliaz and Ok (2006) 
have argued that rational choice theory with incomplete preferences is consistent 
with preference reversals. In our view, incompleteness is an important expression of 
ambiguity in its plain meaning (rather than as a synonym for a non-additive represen- 
tation of likelihood). There are many reasons why a comparison between two objects 
of choice may fail to be resolved: obscurity or indistinctness of their properties, lack 
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of time for or excessive cost of computation, the incomplete enumeration of a choice 
set, and so forth. We recognize indecisiveness in ourselves and others, so it would 
seem strange not to allow for it in any theory of preferences that purports to describe 
tastes (as opposed to a theory which purports to characterize consistent choice). 



3.2 Cancellation 

Axioms such as the independence axiom or the sure thing principle are required to 
get the requisite linearity for an SEU representation. But in their usual form these 
axioms cannot be stated in our framework as they place restrictions on preference 
relations over acts and we do not have acts. Moreover, some of our representation 
theorems apply to finite sets of acts, while the usual statement of mixture axioms 
requires a mixture space of acts. For us, the role of these axioms is performed by 
the cancellation axiom, which we now describe. Although simple versions of the 
cancellation axiom have appeared in the literature (e.g. Scott (1964) and Krantz, 
Luce, Suppes, and Tversky (1971)), it is nonetheless not well known, and so before 
turning to our framework we briefly explore some of its implications in more familiar 
settings. Nonetheless, some of the results here are new; in particular, the results on 
cancellation for partial orders. These will be needed for proofs in the appendix. 

Let C denote a set of choices and y a preference relation on C. We use the 
following notation: Suppose (ai, . . . , a„) and {h,. . . , bn) are sequences of elements 
of C. If for all c e C, #{j : aj = c} = : bj = c}, we write {{ai, . . . a„}} = 
. . . , bn}}. That is, the multisets formed by the two sequences are identical. 

Definition 5 (Cancellation). The preference relation y on C satisfies cancellation 
iff for all pairs of sequences (ai, . . . , a„) and (5i, . . . , &„) of elements ofC such that 

{{ai, . . . ,a„}} = {{bi, . . . ,bn}}, if ai fori < n - 1, thenb^ h a„. 

Roughly speaking, cancellation says that if two collections of choices are identical, 
then it is impossible to order the choices so as to prefer each choice in the first collec- 
tion to the corresponding choice in the second collection. The following proposition 
shows that cancellation is equivalent to reflexivity and transitivity. Although Krantz et 
al. (1971, p. 251), Fishburn (1987, p. 743) have observed that cancellation implies 
transitivity, this full characterization appears to be new. 

Proposition 1 . A preference relation ^ on a choice set C satisfies cancellation iff 
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1 . ^ is reflexive, and 

2. y is transitive. 

Proof. First suppose that cancellation holds. To see that y is reflexive, take n = 1 
and fli = 6i = a in the cancellation axiom. The hypothesis of the cancellation axiom 
clearly holds, so we must have a ^ a. To see that cancellation implies transitivity, 
consider the pair of sequences (a, 6, c) and {b, c, a). Cancellation clearly applies. If 
a^b and by c, then cancellation implies a ^ c. We defer the proof of the converse 
to the Appendix. □ 

We use two strengthenings of cancellation in our representation theorems for 
A and A^, respectively. The first, statewise cancellation, simply increases the set of 
sequence pairs to which the conclusions of the axiom must apply. This strengthening 
is required for the existence of additively separable preference representations when 
choices have a factor structure. Here we state the condition for Savage acts. Given 
are finite sets S of states and O of outcomes. A Savage act is a map f : S ^ O. 
Let C denote a set of Savage acts and suppose that ^ is a preference relation on C. 

Definition 6 (Statewise Cancellation). The preference relation y on a set C of 
Savage acts satisfies statewise cancellation iff for all pairs of sequences (ai, . . . , a„) 

and {bi, ...,bn) of elements ofC, /7{{ai(s), . . . , a„(s)}} = . . . , for 

all s e S, anda-i y b^ fori < n — 1, then bn h an- 

Statewise cancellation is a powerful assumption because equality of the multisets is 
required only 'pointwise'. Any pair of sequences that satisfy the conditions of can- 
cellation also satisfies the conditions of statewise cancellation, but the converse is 
not true. For instance, suppose that S = {si,S2}, and we use (01,02) to refer 
to an act with outcome Oj in state i, i = 1, 2. Consider the two sequences of acts 
((oi, oi), (02, 02)) and ((oi, 02), (02, oi)). These two sequences satisfy the conditions 
of statewise cancellation, but not that of cancellation. 

In addition to the conditions in Proposition [1] statewise cancellation directly 
implies event independence, a condition at the heart of SEU representation theorems 
(and which can be used to derive the Sure Thing Principle). UT C S, let arb be the 
Savage act that agrees with a on T and with b on S - T; that is arb^s) = a{s) if 
s e T and ar&(s) = b{s) if s ^ T. We say that y satisfies event independence iff 
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for all acts a, b, c, and c' and subsets T of the state space S, if arc >z brc, then 
qtc' >: Btc'. 

Proposition 2. If >z satisfies statewise cancellation, then >z satisfies event indepen- 
dence. 

Proof. Take (01,02) = {aTC^hrc') and take (61, 62) = {hTC^axd). Note that for each 

state s e T, {{aTc{s),hTc'{s)}} = {{a{s) , b{s)}} = 

{{6tc(s), aTc'(s)}}, and for each state s ^T, {{arc^s), brc'^s)}} = 

{{c(s), c'(s)}} = {{6tc(s), aTc'{s)}}. Thus, we can apply statewise cancellation to 

get that if arc >z brc, then arc' ^ brc'. □ 

Proposition Q] provides a provides a characterization of cancellation for choices in 
terms of familiar properties of preferences. We do not have a similarly simple char- 
acterization of statewise cancellation. In particular, the following example shows that 
it is not equivalent to the combination of reflexivity and transitivity of >z and event 
independence. 

Example 2. Suppose that S = {si,s2}, O = {01,02,03}. There are nine possible 
acts. Suppose that >z is the smallest reflexive, transitive relation such that 

(oi,oi) y (01,02) y (02,01) y (02,02) y (03,01) y 
(01,03) (02,03) >- (03,02) >- (03,03), 

using the representation of acts described above. To see that y satisfies event inde- 
pendence, note that 

• {x, oi) y {x, 02) h (x, 03) for X e {oi, 02, 03}; 

• (oi, y) h (02, y) y (03, y) for y e {oi, 02, 03}. 

However, statewise cancellation does not hold. Consider the sequences 

((oi, 02), (02, 03), (03, oi)) and ((02, oi), (03, 02), (oi, 03)). 

This pair of sequences clearly satisfies the hypothesis of statewise cancellation, that 

(01,02) h (02,01) and (02,03) y (03,02), but (01,03)^(03,01). | 
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For our representation theorems for complete orders, statewise cancellation 
suffices. However, for partial orders, we need a version of cancellation that is equiv- 
alent to statewise cancellation in the presence of A1 , but is in general stronger. 

Definition 7 (Extended Statewise Cancellation). The preference relation y on a 
set C of Savage acts satisfies extended statewise cancellation if and only if for all 
pairs of sequences (ai, . . . , a„) and (61, ... , 6„) of elements ofC such that 

{{ai(s), . . . ,a„(s)}} = {{bi{s), . . . ,6„(s)}} for all s e S, if there exists some k < n 
such thattti y hi fori < k, a^+i = ■ ■ ■ = a„, and bk+i = ■ ■ ■ = hn, then bn h an- 

Proposition 3. In the presence of AI , extended statewise cancellation and statewise 
cancellation are equivalent. 

Proof. Suppose the hypotheses of extended statewise cancellation hold. If 6„ y 
ttn, we are done. If not, by A1, a„ y bn- But then the hypotheses of statewise 
cancellation hold, so again, 6„ y a„. □ 

The extension of cancellation needed for ^+ is based on the same idea 
as extended statewise cancellation, but probabilities of objects rather than the in- 
cidences of objects are added up. Let C denote a collection of elements from a 
finite-dimensional mixture space. Thus, C can be viewed as a subspace of R" for 
some n, and each component of any c g C is a probability. We can then formally 
'add' elements of C, adding elements of R" pointwise. (Note that the result of adding 
two elements in C is no longer an element of C, and in fact is not even a mixture.) 

Definition 8 (Extended Mixture Cancellation). The preference relation y on C 
satisfies extended mixture cancellation iff for all pairs of sequences (ai, . . . , a„) and 
(61, ... , bn) of elements of C, such that Ya=i = Ya=i there exists some 
k < n such that ai y hi for i < k, a^+i = • ■ • = a„, and 6^+1 = • ■ • = 6„, then 
bn y an- 

We can extend Proposition Q] to get a characterization theorem for preferences on 
mixture spaces by using an independence postulate. The preference order y sat- 
isfies mixture independence if for all a, b, and c in C, and all r e {0,1], a y b iff 
ra + (1 — r)c y rb + {1 — r)c. The preference relation y satisfies rational mixture 
independence if it satisfies mixture independence for all rational r g (0, 1]. 
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Theorem 3. A preference relation y on a finite-dimensional mixture space C satis- 
fies extended mixture cancellation iff y is reflexive, transitive, and satisfies rational 
mixture independence. 

Proof. Suppose that >z satisfies extended mixture cancellation. Then it satisfies 
cancellation, and so from Proposition 1, ^ is reflexive and transitive. To show that 
y satisfies rational mixture independence, suppose that a y b and r = m/n. Let 
ai = ■ ■■ = am = a and a^+i = ■ ■ ■ = a„+„ = rb + {1 - r)c; \et bi = ■ ■ ■ = bm = b 
and Kn+i = ■■■ = bra+n = TO + (1 - r)c. Thon Erit"«i = ES"^*' and so 
ra + (1 — r)c ^ r6 + (1 — r)c. 

Similarly, if ra + (1 — r)c y rb + {1 — r)c, then applying extended mixture 
cancellation to the same sequence of acts shows that ayb. 

For the converse, suppose that y is reflexive, transitive, and satisfies rational 
mixture independence. Suppose that (ai, . . . , a„) and . . . , 6„) are sequences of 

of elements of C such that ai H h a„ = 6i H h «i ^ for i = 1, . . . , n - fc, 

Ofe+i = . . . = a„, and fe^+i = . . . = Then from transitivity and rational mixture 
independence we get that 

-(ai H V an) y-{bi^ Vbk + at+i H h a„) 

n n 

1/7 7 \ n — k 

= -{bi H h Ofe) H an. 

n n 

Since bk+i = ... = &„ and ai H h a„ = 6i + h fe„, we have that 

X j2 — A; 1 1 

+ ■ ■ ■ + + (bn) = -{bi + --- + bn) = -(ai + ■ ■ ■ + an). 

n n n n 

Thus, by transitivity, 

-{bi + --- + bk) + ^(&n) h -{bi + --- + bk) + ^(a„). 

n n n n 

By rational mixture independence, it follows that bn h an- □ 



We can strengthen extended mixture cancellation just as we extended can- 
cellation, by defining a statewise version of it appropriate for AA acts (i.e., functions 
from S to A(0)). For completeness, we give the definition here: 
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Definition 9 (Extended Statewise Mixture Cancellation). The preference relation 
y on a setC of AA acts satisfies extended statewise mixture cancellation iff for all 
pairs of sequences (ai, . . . , a„) and b = (61, . . . , 6„) of elements of C, such that 
Ya=i (^ii^) = Yli=i ^ii^) for all States s, if there exists some k < n such thatai ^ hi 
fori < k, afe+i = ■ ■ ■ = a„, and bk+i = ■ ■ ■ = bn, then bn h an- 

It turns out that we do not needed extended statewise mixture cancellation. 
As the following result shows, it follows from extended mixture cancellation. 

Proposition 4. y satisfies extended statewise mixture cancellation iff y satisfies 
extended mixture cancellation. 

Proof. Clearly if y satisfies extended statewise mixture cancellation, then it satisfies 
extended mixture cancellation. For the converse, suppose that y satisfies extended 
mixture cancellation, X]r=i"i('^) = Z]r=i^*('^) ^" states s, there exists some 
k < n such that flj y bi a^+i = ■ ■ ■ = a„, and bk+i = ■ ■ ■ = bn- Then (l/n)ai) + 

h {l/n)an = {l/n)bi H h {l/n)bn. By rational mixture independence (which 

follows from extended mixture cancellation, by Theorem |3j, since ai y bi, we have 

that (l/?T,)aiH h(l/n)a,„ y {l/n)bi+{l/n)a2-\ l-(l/n)a„. By a straightforward 

induction (using transitivity, which again follows from extended mixture cancellation), 
it follows that 

{l/n)bi + ■■■+ {l/n)bk + {{n - k)/n)bn = {l/n)ai + ■■■ + (l/n)a„ 

y {l/n)b, + --- + {l/n)bk+ 
{{n - k)/n)an. 

Now from mixture independence, it follows that 6„ y a„, as desired. □ 



3.3 The cancellation postulate for choices 

We use cancellation to get a representation theorem for preference relations on 
choices. However, the definition of the cancellation postulates for Savage acts and 
mixtures rely on (Savage) states. We now develop an analogue of this postulate for 
our syntactic notion of choice. 

Definition 10. Given a setTo = {ti, . . . ,tn} of primitive tests, an atom over To is a 
test of the form t[ A . . . A t'^, where t- is either ti or -^U. 
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An atom is a possible complete description of the truth value of tests accord- 
ing to the DM. If there are n primitive tests in To, there are 2" atoms. Let At (To) 
denote the set of atoms over Tq. It is easy to see that, for all tests t e T and atoms 
6 e At(To), and for all state spaces S and standard test interpretations tts, either 
T^si^) ^ 7rs(t) or iTs{S)niTs(t) = 0. (The formal proof is by induction on the structure 
of t.) We write 5 ^ t if the former is the case. We remark for future reference that a 
standard test interpretation is determined by its behavior on atoms. (It is, of course, 
also determined completely by its behavior on primitive tests). 

Definition 11. /An atom 6 (resp., testt) is consistent with a theory AX if there exists 
a state space S and a test interpretation ns e Uax such that iis{^) 7^ (resp., 
Tisit) ^ 0j. /.ef AtAx(^o) denote the set of atoms overT^ consistent with AX. 

Intuitively, an atom 5 is consistent with AX if there is some state in some state space 
where 5 might hold, and similarly for a test t. 

A choice in A can be identified with a function from atoms to primitive choices 
in an obvious way. For example, if ai, 02, and 03 are primitive choices and To = 
{ti, ^2}, then the choice a = if ti then ai else (if t2 then 02 else 03) can be identi- 
fied with the function fa such that 

• faitlM2) = faih A ^^2) = 

• /a(^ii Ata) = 02; and 

• fahh A ^^2) = 03. 

Formally, we define fa by induction on the structure of choices. If a e ^0, then fa is 
the constant function a, and 



We consider a family of cancellation postulates, relativized to the axiom sys- 
tem AX. The cancellation postulate for AX (given the language ^0) is simply state- 
wise cancellation for Savage acts, with atoms consistent with AX playing the role of 
states. 




otherwise. 
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A2'. If (ai, . . . ,an) and (61, ... , bn) are two sequences of choices in Aao,To such 
that for each atom 5 e AtAx(To), {{/a,(5), . . . , /a„(5)}} = . . . , 

and there exists some k < n such that y hi for all i < k, a^+i = ■ ■ ■ = a„, and 
= ■ • • = 6„, then 6„ ^ a„. 

We drop the prime, and refer to A2 when k = n — 1. 

Axiom A2 implies the simple cancellation of the last section, and so the con- 
clusions of Proposition 1 hold: ^ on ^ will be transitive and reflexive. A2 has another 
consequence: a DM must be indifferent between AX-equivalent choices. 

Proposition 5. Suppose that ^ satisfies A2. Then a =ax & implies a ~ fe. 

Proof. Let S = AtAx(7o), the set of atoms consistent with AX, let O be the set 
of primitive choices, and define Psoic) to be the constant function c for a primitive 
choice c. It is easy to see that pso{c) = fc for all choices c. If a =ax b, then 
Pso{a) = Pso{b), so we must have fa = fb- Now apply A2 with fli — Q, and bi — b 
to get by a, and then reverse the roles of a and b. □ 

Proposition [S] implies that the behavior of a and b on atoms not in AtAx(ro) 
is irrelevant; that is, they are null in Savage's sense. We define this formally: 

Definition 12. A testt is null if, for all acts a, b andc, ift then a else c ~ ift then b 
else c. 

An atom (or test) inconsistent with the theory AX is null, but consistent tests may be 
null as well. The notion of a null test is suggestive of, more generally, test-contingent 
preferences. 

Definition 13. Ift is a test in T, then for any acts a and b, a b iff for some c, 
Ift then a else c>z Ift then b else c. 

Proposition [2] shows that statewise cancellation implies that the choice of c is irrele- 
vant, and so test-contingent preferences are well-defined. 

To get a representation theorem for we use a mixture cancellation pos- 
tulate, again replacing states by atoms. The idea now is that we can identify each 
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choice a with a function fa mapping atoms consistent with AX into distributions over 
primitive choices. For example, if t is the only test in To and AX = 0, then the choice 
a = + i(if t then 02 else 03) can be identified with the function fa such that 

. fa{t){a,) = 1/2; fa{t){a2) = 1/2 
. /„H)(ai) = l/2;/,(-t)(a3) = l/2. 

Formally, we just extend the definition of fa given in the previous section by defining 

fra, + {l-r)a2{S) = rfa,{S) + (1 - r)fa^{6). 

Consider the following cancellation postulate: 

A2^ If (ai, . . . , an) and {hi, . . . ,hn) are two sequences of acts in ^J^^ such that 

faA5) + --- + faM = f,A5) + --- + f,M 

for all atoms 5 consistent with AX, and there exists k <n such that ^ hi for i < k, 

ak+i = ... = an, and hk+i = . . . = hn, then 6„ y an- 

Again, A2^ can be viewed as a generalization of A2'. 

A2^ is analogous to extended statewise mixture cancellation. It may seem 
strange that we need the cancellation to be statewise, since Proposition |4] shows 
that extended statewise mixture cancellation is equivalent to extended mixture can- 
cellation. This suggests that we might be able to get away with the following simpler 
axiom: 

A2*. If (ai, . . . ,an) and (61, ... , &„) are two sequences of acts in ^X),ro such that 

fai + ■ ■ ■ + fan ~ fbi + ■ ■ ■ + fbn i 

and there exists k < n such that ai y hi^or i = 1, . . . ,k, ak+i = . . . = an, and 

hk+i = ... = hn, then hn h an- 

A2* is implied by A2^ but they are not quite equivalent. To get equivalence, we 
need one more property: 
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EQUIV. If fa = h, then a ~ 6. 

EQUIV says that all that matters about a choice is how it acts as a function from tests 
to primitive choices. 

Proposition 6. A preference order ^ on choices satisfies A2^ iff it satisfies A2* and 
EQUIV. 

Proof. If >z. satisfies A2^ then clearly ^ satisfies A2*. To see that ^ satisfies 
EQUIV, suppose that fa = ft- A straightforward argument by induction on the struc- 
ture of a shows that, for all sets S of states, sets O of outcomes, test interpretations 
TTs, and choice interpretations pso, we have that pso{a){s) = pso{fa{5)), where 6 is 
the unique atom such that s g usi^)- Similarly, pso{b){s) = psoifbi^))- Thus, since 
fa = fb, Pso{o) = Pso{b). It follows that fa = fb implies a = b. It now follows from 
Proposition [5]that a ~ 6. 

For the converse, since /«!+■■■ + /«„ = fbi + ■ ■ ■ + fb„, it follows that 
fi/n{ai)+-+i/nia„) = /i/n(6i )+-+i/n(b,o " Applylng EQUIV, WO concludo that 

l/n(ai) H h l/n(a„) ~ l/n(6i) H h l/n(6„). We can now continue as in the 

proof of Proposition m □ 



4 Representation Theorems 

Having discussed our framework, we now turn to the representation theorems. Our 
goal is to be as constructive as possible. In this spirit we want to require that pref- 
erences exist not for all possible acts that can be described in a given language, but 
only for those in a given subset, henceforth designated C. We are agnostic about the 
source of C. It could be the set of choices in one particular decision problem, or it 
could be the set of choices that form a universe for a collection of decision problems. 
One cost of our finite framework is that we will have no uniqueness results. In our 
framework the preference representation can fail to be unique because of our free- 
dom to choose different state and outcome spaces, but even given these choices, the 
lack of richness of C may allow multiple representations of the same (partial) order. 
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4.1 A Representation Theorem for A 

By a representation for a preference order on A we mean the following: 

Definition 14. >A preference relation on a set C C Aao,To has a constructive AX- 
consistent SEU representation iff there is a finite set of states S, a finite set O of 
outcomes, a setU of utility functions u : O K, a setV of probability distributions 
on S, a subset V CU x V, a test interpretation ns consistent with AX, and a choice 
interpretation pso such that b iff 

^u{pso{a){s))p{s) > ^u{pso{b){s))p(s) forall{u,p) G V. 

We are about to claim that y satisfies A2' if and only if it has a constructive 
AX-consistent representation. In the representation, we have a great deal of flexibility 
as to the choice of the state space S and the outcome space O. One might have 
thought that the space of atoms, AtAx(^o)- would be a rich enough state space on 
which to build representations. This is not true when preferences are incomplete. A 
rich enough state space needs also to account for the incompleteness. 

Definition 15. Given a partial order ^ on a set C of choices, let EXAxih) denote 
all the extensions ofy to a total order on C satisfying A2. 

Our proof shows that we can take S to be AtAx(^o) x EX^xih)- Thus, in 
particular, if >z is complete, then we can take the state space to be AtAx(^o)- We later 
give examples that show that if y is not complete then, in general, the state space 
must have cardinality larger than that of AtAx(To)- While for some applications there 
may be a more natural state space, our choice of state space shows that we can 
always view the DM's uncertainty as stemming from two sources: the truth values of 
various tests (which are determined by the atom) and the relative order of two choices 
not determined by >z (which is given by the extension >z' g EXxxih) of >z). The idea 
of a DM being uncertain about her preferences is prevalent elsewhere in decision 
theory; for instance, in the menu choice literature (Kreps 1979). This uncertainty 
can be motivated in any number of ways, including both incomplete information and 
resource-bounded reasoning. 

Theorem 4. A preference relation y on a set C C AAo,Ta has a constructive AX- 
consistent SEU representation iffy satisfies A2'. Moreover, in the representation, 
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either V orU can be taken to be a singleton and, ifU is a singleton {u}, the state 
space can be taken to be AtAx(ro) x EXAx{h)- If, in addition, y satisfies A1, then 
V can be taken to be a singleton (i.e., both V andU can be taken to be singletons). 

TheoremHlis proved in the appendix. The proof proceeds by first establishing a state- 
dependent representation using as the outcome space, and then, by changing 
the outcome space, 'bootstrapping' the representation to an EU representation. This 
technique shows that, when the state and outcome spaces are part of the represen- 
tation, there is no difference between the formal requirement for a state-dependent 
representation and that for a SEU representation. This does not mean that expected 
utility comes 'for free'; rather, we interpret it to mean that the beliefs/desires formalism 
that motivates expected utility theory is sensible for the decision problems discussed 
in this subsection only if the particular outcome space chosen for the representation 
has some justification external to our theory. We note that if preferences satisfy A1 , 
the theorem requires only the cancellation axiom A2 rather than the stronger A2'. 

There are no uniqueness requirements onV orU in Theorem m In part, this 
is because the state space and outcome space are not uniquely determined. But 
even if A1 holds, so that the state space can be taken to be the set of atoms, the 
probability and the utility are far from unique, as the following example shows. 

Example 5. Take = W,b}, Tq = {t}, and AX = 0. Suppose that y is the 
reflexive transitive closure of the following string of preferences: 

ay \H then a else by itt then b else ay b. 

Every choice in A is equivalent to one of these four, so A1 holds, and we can take the 
state space to be S* = {t, -^t}. Let O* = {oi, 02} , and define Ps-o* so that pg,Q,{a) 
is the constant function oi and Ps*o*ib) the constant function 02. Now define vr^* 
in the obvious way, so that ns*(t) = {t} and ns-'{-^t) = {^t}. We can represent the 
preference order by using any probability measure p* such that p*{t) > 1/2 and any 
utility function u* such that u*{oi) > u*{o2). I 

As Example |5] shows, the problem really is that the set of actions is not rich 
enough to determine the probability and utility. By way of contrast. Savage's postu- 
lates ensure that the state space is infinite and that there are at least two outcomes. 
Since the acts are all functions from states to outcomes, there must be uncountably 
many acts in Savage's framework. 
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The next example shows that without the completeness axiom A1 , there may 
be no representation in which there is only one utility function and the state space is 

AtAx(To). 

Example 6. Suppose that To = 0, AX = 0, and Ao (and hence A) consists of the 
two primitive choices a and b, which are incomparable. In this case, the smallest 
state space we can use has cardinality at least 2. For if l^l = 1, then there is only 
one possible probability measure on S, and so a single utility function ranks a and b. 
Since there is only one atom when there are no primitive propositions, we cannot take 
the state space to be the set of atoms. There is nothing special about taking Tq = 
here; similar examples can be constructed showing that we cannot take the state 
space to be AtAx(7o) for arbitrary choices of To if the preference order is partial. An 
easy argument also shows that there is no representation where \0\ = 1. 

This preference relation can be represented with two outcomes and two states. 
Let S = {si,s2} and O = {01,02}. Define Psoi(^)i^i) = Oi, and Pso(^)('5i) = ^2-* 
for i = 1,2. Let U contain a single function such that u{oi) ^ u{o2). Let V be any 
set of probability measures including the measures pi and p2 such that pi(si) = 1 
and P2{si) = 0. Then the expected utility ranking of randomized acts under each 
Pi contains no nontrivial indifference, and the ranking under p2 is the reverse of that 
under pi. Thus, these choices represent the preference order. | 



4.2 A Representation Theorem for 

The purpose of this subsection is to show that for the language we can get 
something much in the spirit of the standard representation theorem for AA acts. 
The standard representation theorem has a mixture independence axiom and an 
Archimedean axiom. As we have seen, A2^ gives us rational mixture independence; 
it does not suffice for full mixture independence. To understand what we need, recall 
that the standard Archimedean axiom for AA acts has the following form: 

Arch. If a ^ 6 ;^ c then there exist r, r' e (0, 1) such that a >~ ra + {1 — r)c y b >- 

r'a + (1 — r')c >- c. 

While this axiom is both necessary for and implied by the existence of an SEU 
representation when y is complete, the following example describes an incomplete 
y with a multi-probability SEU representation which fails to satisfy Arch. 
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Example 7. Suppose that S = {si,s2,s3}. Let ai, 02, and 03 be acts such that 
ai{sj) gives an outcome of 1 \H = j and othenwise. Let V consist of all probability 
distributions p on S such that p{si) > p{s2) > p{sz)- Define ^ by taking a ^ h 
iff the expected outcome of a is at least as large as that of h with respect to all the 
probability distributions in V. It is easy to see that a^, but for no r g (0, 1) 

is it the case that rai + (1 - ri)a3 y 02 (consider the probability distribution p such 
that p{si) =p{s2) = 1/2). I 

We can think of the Archimedean axiom as trying to capture some continuity 
properties of y. We use instead the following axiom, which was also used by Aumann 
(1962, 1964). If the set of tests has cardinality n and the set of primitive choices has 
cardinality m, we can identify an act with an element of R^"™, so the graph of >z 
can be viewed as a subset of R^"^^"". 

A3. The graph of the preference relation y is closed. 

As the following result shows, in the presence of A2^^ (extended statewise 
mixture cancellation), A3 implies full mixture independence. Moreover, if we also 
assume A1, then A3 implies Arch. Indeed, it will follow from Theorem [8] that in 
the presence of AI and A2^ A3 and Arch are equivalent. On the other hand, it 
seems that Arch does not suffice to capture independence if ^ is a partial order. 
Summarizing, A3 captures the essential features of the Archimedean property, while 
being more appropriate if >z is only a partial order. 

Proposition 7. (a) A2^^ and A3 imply full mixture independence, 
(b) AI, A3, and extended mixture cancellation together imply Arch. 

Proof. For part (a), suppose that a y b, and c is an arbitrary act. By Theorem |3l 
rational mixture independence holds, so we have ra + (1 — r)c y r6 + (1 — r)c 
for all rational r. By A3, we have ra + (1 — r)c y rb + {1 — r)c for all real r. 
Conversely, suppose that ra + (1 — r)c y rb + {1 — r)c for some real r. If r is 
rational, it is immediate from rational mixture independence that a y b. If r is not 
rational, choose a rational r' such that < r' < r. Then we can find a sequence of 
rational numbers r„ such that r„r converges to r'. By rational mixture independence, 
r„(ra + (1 - r)c) + (1 - r„)c y rn{rb + (1 - r)c) + (1 - r„)c. By A3, it follows that 
r'a + (1 — r')c y r'b + (1 — r')c. Now by rational mixture independence, we have 
a ^ 6, as desired. 
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For part (b), suppose that a y b y c. Mixture independence (which follows 
from A2^ and A3, as we have observed) implies that, for all r e (0, 1), a y ra + 
(1 - r)c. To see that ra + (1 - r)c >~ b for some r G (0, 1), suppose not. Then, by 
A1 , fe ^ ra + (1 - r)c for all r G (0, 1), and by A3, we have that by a, contradicting 
our initial assumption. The remaining inequalities follow in a similar fashion. □ 

Definition 16. /\ preference relation y on a set C C j^^, fias a constructive AX- 
consistent SEU representation iff there is a finite set of states S, a finite set O of 
outcomes, a set U of utility functions n : O ^ R, a closed set V of probability 
distributions on S, a closed setV CU x V, a test interpretation tts consistent with 
AX, and a choice interpretation pso such that ay b iff 

J2^(o)pso{a){s){o)p{s) > ^u{o)pso{b){s){o)p{s) forall{u,p) G V. 

s,o s,o 

In the statement of the theorem, if ^ is a preference relation on a mixture- 
closed subset of ^io^To' '-'2® - ® ('^' ^) *° denote the smallest preference order 
including y and (a, b) satisfying A2^ and A3, and take EX^^^y) to consist of all 
complete preference orders extending y and satisfying A2^ and A3. 

Theorem 8. A preference relation y ona closed and mixture-closed set C C A'^^^j^^ 
has a constructive AX-consistent SEU representation iff y satisfies A2^ and A3. 
Moreover, in the representation, either V orU can be taken to be a singleton and, if 
U is a singleton {u}, the state space can be taken to be At^xiTo) x EX^^^y). If, in 
addition, y satisfies A1, then V can be taken to be a singleton. 

As in the case of the language A, we cannot in general take the state space 
to be the set of atoms. Specifically, if consists of two primitive choices and 
we take all choices in Aq to be incomparable, then the same argument as in Ex- 
ample m shows that we cannot take S to be At(To), and there are no interesting 
uniqueness requirements that we can place on the set of probability measures or 
the utility function. On the other hand, if A1 holds, the proof of Theorem [8] shows 
that, in the representation, the expected utility is unique up to affine transforma- 
tions. That is, if (S*, 0,p, vrg, p^^, m) and {S',0',p',7is', Ps'o'y'^') ^""^ both repre- 
sentations of y, then there exist constants a and P such that for all acts a G ^X,To' 
Ep{u{pso{a))) = aEp>{u'{ps'o'ia))) + p. 
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4.3 Objective Outcomes 

In choosing, for instance, certain kinds of insurance or financial assets, there is a 
natural, or objective, outcome space — in these cases, monetary payouts. To model 
this, we take the set O of objective outcomes as given, and identify it with a subset 
of the primitive acts Aq. Call the languages with this distinguished set of outcomes 
.4.^0,^0,0 and ^X),To,0' depending on whether we allow randomization. 

To get a representation theorem in this setting, we need to make some stan- 
dard assumptions. The first is that there is a best and worst outcome; the second 
is a state-independence assumption. However, this state-independence assumption 
only applies to acts in O, but not to all acts. 

A4. There are outcomes oi and oq such that for all non-null tests t, oi a ht oq for 
all a e Aq. 

A5. If t is not null and o, d e O, then o ^ o' iff o o' . 

In all our earlier representation theorems, it was possible to use a single utility 
function. A4 and A5 do not suffice to get such a representation theorem. A nec- 
essary condition to have a single utility function, if we also want utility to be state 
independent, is that ^ restricted to O be complete. 

A6. ^ restricted to O is complete. 

While A5 and A6 are necessary to get a representation with a single utility 
function, they are not sufficient, as the following example shows. 

Example 9. Suppose that we have a language with one primitive test t, and three out- 
comes, oo, oi, and o. Let be if t then oq else oi and let 02 be if t then oi else oq. 
Let >z. be the smallest preference order satisfying A2', A4, A5, and A6 (or A2^ 
A3, A4, A5, and A6, if we are considering the language A^) such that o ~ ai 
and oi )~ Oq. Note that ai and 02 are incomparable according to ^. Suppose that 
there were a representation of ^ involving a set V of probability measures and a 
single utility function u. Thus, there would have to be probability measures 'p\ and 
P2 in V such that ai >~ 02 according to and >~ ai according to {p2,u). It 

easily follows that pi(7rs'(t)) < 1/2 and p2{ns(t)) > 1/2. We can assume without 
loss of generality (by using an appropriate affine transformation) that n(oo) = and 
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u{oi) = 1. Since o ~ ai, u{o) must be the same as the expected utility of ai. But 
this expected utility is less than 1/2 with pi and more than 1/2 with p2. This gives the 
desired contradiction. | 

Part of the problem is that it is not just the acts in O that must be state inde- 
pendent. Let 0+ be the smallest set of acts containing O that is closed under convex 
combinations, so that if o and o' are in 0+, then so is ro + (1 — r)o'. Let AS'^ and 
A6"*" be the axioms that result by replacing O by 0+ in A5 and A6, respectively. 
Example |9]actually shows that A5+ and A6 do not suffice to get a single utility func- 
tion; Theorem do] shows that A5^ and A6^ do, at least for We do not have a 
representation theorem for A, and believe it will be hard to obtain such a theorem (for 
much the same reasons that it is hard to get a representation theorem in the Savage 
setting if we restrict to a finite set of acts). 

Theorem 10. A preference relation onasetC C A\^ j,^^ o ^ constructive SEU 
representation with outcome space O iffy satisfies A2^ A3, A4, A5"*", and A6^. 
Moreover, in tfie representation, U can be taken to be a singleton {u} and the state 
space can be taken to have the form AtAx(^o) x x £'-^ax(-)- addition >z 
satisfies A1, then we can take V to be a singleton too. 

Note that, even if >z satisfies AI, the state space has the form AtAx(7o) x^o- 
The fact that we cannot take the state space to be AtAx(^o) is a consequence of our 
assumption that primitive acts are deterministic. Roughly speaking, we need the 
extra information in states to describe our uncertainty regarding how the primitive 
acts not in O can be viewed as functions from states to outcomes in the pre-specified 
set O. The following example shows that we need the state space to be larger than 
AtAx(To) in general. 

Example 11. Suppose that there are no primitive proposition, so AtAx(^o) is a sin- 
gleton. There are three primitive acts in Ao- oi = $50000, oq = $0, and a, which is 
interpreted as buying 100 shares of Google. Suppose that oi>~ a y oq. If there were 
a representation with only one state, then pso{a) would have to be either oi or oq, 
which would imply that a ~ oi or a ~ oq, contradicting our description of y. The is- 
sue here is our requirement that a primitive choice be represented as a function from 
states to outcomes. If we could represent a as a lottery, there would be no problem 
representing y with one state. We could simply take n(oi) = 1, n(oo) = 0, and take 
a to be a lottery that gives each of oq and oi with probability 1/2. 
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We prefer not to allow the DM to consider such 'subjective' lotteries. Rather, 
we have restricted the randomization to acts. The representation theorem would not 
change if we allowed primitive choice to map a state to a distribution over outcomes, 
rather than requiring them to be mappings from states to single outcomes (except 
that we could take the state space to be AtAx(7o))- 

We can easily represent ^ using two states, sq and si, by taking a to be the 
act with outcome Oj in state s/, for z = 0, 1. Taking each of sq and si to hold with 
probability 1/2 then gives a representation of ^. In this representation, we can view 
So as the state where buying Google is a good investment, and si as the state where 
buying Google is a bad investment. However, the DM cannot talk about Google 
being a good investment; this is not part of his language. Another DM might explicitly 
consider the test that Google is a good investment. Suppose this DM has the same 
preference relation over primitive acts as in the example, is indifferent between 1 00 
shares of Google and oi if the test is true, and is indifferent between 100 shares of 
Google and oq if the test is false. This DM's preference order has exactly the same 
representation as the first DM's preference order, but now sq can be viewed as the 
atom where the test is false, and si can be viewed as the atom where the test is true. 
The second DM can reason about Google being a good investment explicitly, and 
can talk to others about it. | 



5 Nonstandard Hypothesis Interpretations 

Many framing problems can be viewed as failures of extensionality, the principle that 
says that two equivalent descriptions of the same decision problem should lead to 
the same choices. While this axiom seems appealing, it often fails in laboratory 
tests. Different descriptions of the same events often give rise to different judgments. 
Perhaps the best-known example is the medical treatment experiment considered in 
ExampleQ] but there are many others. For example, Johnson et al. (1993) found that 
subjects offered hypothetical health insurance were willing to pay a higher premium 
for policies covering hospitalization for any disease or accident than they were for 
policies covering hospitalization for any reason at all. 

But what makes two descriptions of events equivalent? In summarizing fail- 
ures of extensionality, Tversky and Koehler (1 994, p. 548) conclude that '. . . probability 
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judgments are attached not to events but to descriptions of events.' In our frame- 
work, events are described by tests. Whether two sets of tests are recognized by 
a DIVI as semantically equivalent is determined by her world view, that is, her the- 
ory AX. For instance, suppose that this year's discussion of the failure of the New 
York Yankees baseball team involves the hypothesis ti, 'they failed because of a 
weak defense.' One would have to know more baseball than some of our readers 
surely do to understand that ti is equivalent to t2 V t-^, where t2 is 'they had bad 
pitching', and is 'they have poor fielding'. Suppose that a DM must make some 
decisions to remedy the failures of this year's team. How might her decision problem 
be represented? If ti t2 V is not part of her theory, then the DM's decision 
problem might be represented by a state space S and a test interpretation ns such 
that ns(ti) 7^ usih) U TTsits). On the other hand, if her knowledge of baseball is 
sufficiently refined (as has often been the case for those actually making such deci- 
sions), then ti h will be part of her theory, and so for any state space S and 
test interpretation tt^ e Uax, T^sih) = -^sih) U nsits). 

We are not taking a stand on the normative implications of extensionality fail- 
ures. Our point is that extensionality and its failure is a product of the theory of the 
world AX that a DM brings to the decision problem at hand (and how it compares 
to the experimenter's or modeler's view of the world). One can extend conventional 
expected utility to state spaces and act spaces that admit failures of extensionality. A 
failure of extensionality is not inconsistent with the existence of an SEU representa- 
tion on a suitably constructed state space. Moreover, if we modelers take to h to 
be an axiom that describes the world, but our DM disagrees, then the probability of 
the set (vr5(to)/7r5(ti)) U {ix s{ti) / s{ti))) measures the degree of framing bias from 
the modeler's point of view. It could be used in a modeling exercise to qualify the 
effect of framing failures in particular decision problems, and in empirical studies to 
measure the degree of framing bias. 

Failures of extensionality are concerned with a semantic issue: Identifying 
when two descriptions of an event are equivalent. However, the same issue arises 
with respect to logical equivalence. For instance, suppose act a gives a DM x if 
-i((-iti A -its) V (-it2 A -its)) is true, and y otherwise, and act h gives the DM x if 
(ti At2) Vts is true, and y otherwise. Only someone adept at formula manipulation (or 
with a good logic-checking program) will recognize that acts a and h axe equivalent 
as a matter of logic because the equivalence of the two compound propositions is a 
tautology. So far we have required that DMs be logically omniscient, and recognize 
all such tautologies, because we have considered only standard interpretations. 
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An interpretation its on a state space S does not have to be standard; all that 
is required is that it associate with each test a subset of S. By allowing nonstan- 
dard test interpretations, we can back off from our requirement that DM's know all 
tautologies. This gives us a way of modeling failures of logical omniscience and, in 
particular, resource-bounded reasoning by DMs. 

Recall that a standard test interpretation is completely determined by its be- 
havior on the primitive tests. However, in general, there is no similar finite character- 
ization of a nonstandard test interpretation. To keep things finite, when dealing with 
nonstandard interpretations, we assume that there is a finite subset T* of the set T 
of all tests such that the only tests that appear in choices are those in T*. (This is 
one way to model resource-bounded reasoning.) With this constraint, it suffices to 
consider the behavior of a nonstandard interpretations only on the tests in T*. Let 
^A),T* consist of all choices whose primitive choices are in and whose tests are 



The restriction to choices in ^^o,t* allows us to define the cancellation pos- 
tulate in a straightfonward way even in the presence of nonstandard interpretations. 
A truth assignment to T* is just a function v : T* ^ {true, false}. We can identify 
an interpretation on S with a function that associates with every state s G S* the truth 
assignment Vg such that Vs{t) = true iff s e ir{t). For a standard interpretation, 
we can use an atom instead of a truth assignment, since for a standard interpreta- 
tion, the behavior of each truth assignment is determined by its behavior on primitive 
propositions, and we can associate with the truth assignment Vg that atom 6s such 
that t is a conjunct in 6s iff Vs{t) = true. These observations suggest that we can 
consider truth assignments the generalization of atoms once we move to nonstan- 
dard interpretations. Indeed, if we do this, we can easily generalize all our earlier 
theorems. 

In more detail, we now view a choice as a function, not from atoms to prim- 
itive choices, but, more generally, as a function from truth assignments to primitive 
choices. As before, we take primitive choices to be constant functions. The choice 
a = if ti tlien ai else (if ^2 tiien 02 else 03) can be identified with the function 
such that 



all in T*. 




if v{ti) = true 
if v{ti) = false 
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and 




a2 if v{t2) = true 
as if v(t2) = false. 



A truth assignment v is consistent with AX if v{t) = true for all tests t e AX. 

With these definitions in hand, all our earlier results hold, with the following 
changes: 

• we replace Aao,to by Aao,t*' 

• we replace 'atoms 6 over Tq' by 'truth assignment to T*'. 

The cancellation axioms are all now well defined. With these changes, Proposition [5] 
and Theorems miSl and [TO] hold with essentially no changes in the proof. Thus, we 
have representation theorems that apply even to resource-bounded reasoners. 



There is nothing unique about the state space chosen for an SEU representation of 
a given choice problem. Our representation theorems state that if an SEU represen- 
tation exists on any given state space and outcome space with test and choice inter- 
pretation functions, then preferences satisfy the appropriate cancellation and other 
appropriate axioms. Our proofs, however, show that (for standard interpretations) we 
can always represent a choice situation on the state space AtAx(To) x ^-^ax(^), or 
AtAx(ro) X ^0 X -E'-^Ax(^) for the objective-outcomes case, so this construction is 
in some sense canonical. 

In our models there are two kinds of information. A DM can learn more about 
the external world, that is, learn the results of some tests. A DM can also learn more 
about her internal world, that is, she can learn more about her preferences. This 
learning takes the form of adding more comparisons to her (incomplete) preference 
order. To make this precise, given a preference order ^ on a set C c AAa,Ta sat- 
isfying A2', let >: © (a, b) be the smallest preference order including y and (a, b) 
satisfying A2'. (There is such a smallest preference order, since it is easy to see that 
if y' and y" both extend y, include (a, b), and satisfy A2', then so does y' n y".) 



6 Updating 
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If we take the state space to be AtAx(7o) x EXax{>i), then a DM's prefer- 
ence order conditioning on either new test information or new comparison information 
can be represented by conditioning the original probability measures. If P is a set 
of probability distributions on some set S and E is a measurable subset of S, let 

V \ E = {q : q = p{- \E) ior some p eV with p{E) > 0}. That is, in computing 

V \ E,\Ne throw out all distributions p such that p{E) = 0, and then apply standard 
conditioning to the rest. LeW \ t = V \ nsit). In the theorems below, we condition 
on a test t and on a partial order y' extending ^. We are implicitly identifying t with 
the event {6 e AtAx(7o) : 6 t}, and h' with the set of total orders in EXAxih) 
extending ^. 

Theorem St. Under the assumptions of Theorem m and with a representation of >z 
in which S = AtAx(7o) x EXax{>i) and W is a singleton {u}, is represented by 

V 1 1 and u, and ^ © (a, h) is represented by P | © (a, 6)) and u. 

Theorem lit. Under the assumptions of Theorem [8l and with a representation of ^ 
in which S = AtAx(7o) x EX^y^{>z) and W is a singleton {u}, is represented by 

V 1 1 and {n}, and ^ © (a, 6) is represented by P | © (a, 6)) and u. 

TheoremFTOb. Under the assumptions of Theorem[iOl and with a representation of >z 
in which S = AtAx(To) x x EX^y^{y) and W is a singleton {u}, is represented 
byV\t and n, and >z © (a, 6) is represented byV\{y © (a, b)) and u. 

Information in the external world is modeled as a restriction on the set of fea- 
sible acts; information in the internal world is adding comparisons to a the preference 
order. These theorems show that both kinds of information can be modeled within a 
Bayesian paradigm. 



7 Conclusion 

Our formulation of decision problems has several advantages over more traditional 
formulations. 

• We theorize about only the actual observable choices available to the DM, 
without having states and outcomes, and without needing to view choices as 



33 



functions from states to outcomes. Indeed, we show that we can determine 
whether a DIVI's behavior is consistent with SEU despite not having states and 
outcomes. In contrast, in many decision theory experiments, when the DM 
is given a word problem, the experimenter has an interpretation of this prob- 
lem as a choice among Savage acts. The experimenter is then really testing 
whether the DM's choices are consistent with decision theory given this inter- 
pretation. Thus, a joint hypothesis is being tested. Standard decision theory 
can be rejected only if the other part of the joint test — that the experimenter 
and DM interpret represent the word problem with identical Savage acts — is 
maintained as true. This is unsatisfactory. As we have shown, our approach 
does place restrictions on choice; thus, our model can be rejected directly by 
observations of choice between choices observable by the experimenter. 

• By viewing choices as syntactic objects, our approach allows us to consider 
DMs that associate different meanings to the same object of choice. Moreover, 
that meaning can depend on the DM's theory of the world. A DM might have a 
theory that does not recognize equivalences between tests, and thus choices, 
that may be obvious to others. This potential difference between a DM's theory 
of the world and an experimenter's view of the world provides an explanation 
for framing effects, while still allowing us to view a DM as an expected util- 
ity maximizer. Moreover, since a DM's theory may not contain all of standard 
prepositional logic, we can model resource-bounded DMs who cannot discern 
all the logical consequences of their choices. The existence of an SEU rep- 
resentation and the presence of framing effects are independent issues once 
one is free to choose a state space. We have modeled framing as a semantic 
issue, and it appears in the relationship between states of the world and state- 
ments about the world in the DMs language. This refutes the unwritten but 
oft voiced implication that in the presence of extensionality failures, decision 
theory is irrelevant. 

• Our approach allows us to consider different DMs who use different languages 
to describe the same phenomena. To see why this might be important, con- 
sider two decision makers who are interested in 100 shares of Google stock 
and money (as in Example Qj}. Suppose that one DM considers quantitative 
issues like price/earnings ratio to be relevant to the future value of Google, 
while the other considers astrological tables relevant to Google's future value. 
The DM who uses astrology might not understand price/earnings ratios (the no- 
tion is simply not in his vocabulary) and, similarly, the DM who uses quantitative 
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methods might not understand what it means for the moon to be in the seventh 
house. Nevertheless, they can trade Google stock and money, as long as they 
both have available primitive actions like 'buy 100 shares of Google' and 'sell 
100 shares of Google'. If we model these decision problems in the Savage 
framework, we would have to think of assets as Savage acts on a common 
state and outcome space. Our approach does not require us to tie the DM's 
decision problems together with a common state space. Every DM acts as if 
she has a state space, but these state spaces may be different. Thus, agreeing 
to disagree results (Aumann 1976), which say that DMs with a common prior 
must have a common posterior (they cannot agree to disagree) no longer hold. 

• A fourth advantage of our approach is more subtle but potentially profound. 
Representation theorems are just that; they merely provide a description of 
a preference order in terms of numerical scales. Decision theorists make no 
pretense that these representations have anything to do with the cognitive pro- 
cesses by which individuals make decisions. But to the extent that the lan- 
guage of choices models the language of the DM, we have the ability to inter- 
pret the effects of cognitive limitations having to do with the language in terms 
of the representation. Our approach allows us to consider the possibility that 
there may be limitations on the space of choices because some sequence of 
tests is too computationally costly to verify. Our model of nonstandard test in- 
terpretations also takes into account a DM's potential inability to recognize that 
two choices logically represent the same function. 

There is clearly still much more to do to develop our approach. We briefly 
mention a few topics here. 

• Learning and dynamic decision-making: Our focus has been on static deci- 
sion making. Dealing with decision-making overtime will require us to consider 
learning in more detail. Learning in our framework is not just a matter of con- 
ditioning, but also learning about new notions (i.e., becoming aware of new 
tests). Note that considering dynamic decision-making will require us to take 
a richer collection of objects of choice, a programming language that allows 
(among other things) sequential actions (do this, then do that, then do that). 

• Multi-agent decision making: We have focused on the single-agent case. 
As we have suggested in examples, once we move to a multi-agent case, 
we can consider different agents who may use different languages. There 
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is clearly a connection here between our framework and the burgeoning lit- 
erature on awareness and its applications to game theory (see, for exam- 
ple, (Feinberg 2004, Fagin and Halpern 1988, Halpern 2001, Halpern and 
Rego 2006, Heifetz, Meier, and Schipper 2006, Modica and Rustichini 1999) 
that needs to be explored. 

• Modeling other 'deviations' from rationality: We have shown how our ap- 
proach can model framing problems as a consequence of the agent having 
a different theory from the modeler. We believe that our approach can also 
model other 'deviations' from rationality of the type reported by Luce (1990), 
which can be viewed as a consequence of an agent's bounded processing 
power. This will require us to be able to distinguish programs such as, for ex- 
ample, 2/3(l/4a + 3/46) + l/3c = l/6a + 5/6(3/56 + 2/5c). To do that, we 
need to give semantics to choices that does not view them as functions from 
states to distributions over outcomes. 

The strategy of 'constructive decision theory' is to use a language to model the DMs 
statements about the world rather than to insist on Savage's states, construct choices 
from a given set of primitive objects of choice and propositions in the language, and 
then to provide semantics for the language and objects of choice in terms of (subjec- 
tive) states and outcomes. We applied this strategy to choice under uncertainty, but 
we believe it can be usefully employed in other domains of choice as well, such as 
intertemporal decision making and interpersonal choice. 



Appendix 

Proof of Proposition [U We need to prove the converse part of the proposition. For 
the converse, suppose that y is reflexive and transitive. By way of contradiction, 
suppose that (ai, . . . , a„) and (6i, . . . , 6„) are two sequences of minimal cardinality 
n that violate cancellation; that is, {{ai, . . . , a„}} = . . . , >z hi for 

i e {1, . . . , n - 1}, and it is not the case that 6„ y an 

If n = 1, and {{a}} = {{b}}, then we must have a = b, and the cancellation 
postulate holds iff a, which follows from our assumption that >z is reflexive. 
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If n > 1, since the two multisets are equal, there must be some permutation 
r of {1, . . . ,n} such that a^(j) = bi. Let r-'(l) be the result of applying r j times, 
beginning with 1. Let A; be the first integer such that r''+^(l) is either 1 or n. Then we 
have the situation described by the following table, where the diagonal arrow denotes 
equality. 

ai y bi 

/ 

ar(l) ^ ^r(l) 
/ 

/ 

G-T^{\) h &rfe(l) 

Note that we must have k < n~ 1. If t^~^^{1) = 1, then 6^fe(j) = ai. Thus, the multi- 
sets {{ai, . . . , a^fe(i)}} and {{bi, . . . , must be equal. The sequences that re- 
main after removing {{ai, . . . , a^fc(i)}} from the first sequence and {{bi, . . . , b^k^i-^}} 
from the second also provide a counterexample to the cancellation axiom, contradict- 
ing the minimality of n. Thus, r''+^(l) = n, and we can conclude by transitivity that 

ai y On- 

Continuing on with the iteration procedure starting with Cl^k+2(^l^ — (Xr{n) — t)n, 
we ultimately must return to ai and bi, as illustrated in the following table: ai and bi. 

bn = ar'= + l(l) ^ ^r'= + l(l) 
/ 

/ 

ar'il) h ^rl(l) 0-1 

It follows from transitivity that bn h ai. By another application of transitivity, we 
conclude that 6„ y an- This contradicts the hypothesis that the original sequence 
violated the cancellation axiom. □ 

We now prove the representation theorems: Theorems S [8l and [TOl They 
all use essentially the same technique. It is convenient to start with Theorem |8l 
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The first step is to get an additively separable utility representation for AA acts on 
a state space S with outcome space O. This result is somewhat novel because we 
use extended mixture cancellation and A3 rather than independence and Arch, and 
because y can be incomplete. 

Theorem 12. A preference relation y on a set C of mixture-closed AA acts map- 
ping a finite set S of states to distributions over a finite set O of outcomes satisfies 
Extended Mixture Cancellation and A3 iff there exists a set U of utility functions on 
S xO such that a y biff 



for all u eU. Moreover, y also satisfies A1 iff we can take U to be a singleton {u}. 
In this case, u is unique up affine transformations: if u' also satisfies 0), then there 
exist a and (3 such that u' = au + [3. 

Proof. In the totally ordered case, this result is well known. Indeed, for a prefer- 
ence order y that satisfies Al, Proposition 7.4 of (Kreps 1988) shows that such a 
representation holds iff y satisfies Arch, mixture independence, transitivity, and re- 
flexivity. Theorem [3] and Proposition |7] show that if y satisfies extended cancellation 
and A3, then these properties hold, so there is a representation. Conversely, if there 
is such a representation, then all these properties are easily seen to hold. It follows 
that in the presence of Al, extended cancellation and A3 are equivalent to these 
properties. However, since we do not want to assume Al, we must work a little 
harder. Fortunately, the techniques we use will be useful for our later results. 

To see that the existence of a representation implies Extended Mixture Can- 
cellation and A3, first consider Extended Mixture Cancellation, and suppose that 

(ai, . . . , an) and (6i . . . , 6„) are such that ai ^ 6i, . . . , cik h bk, ak+i = . . . = an, 

bk+i = ■ ■ ■ = bn, and ai + h a„ = 6i + ■ ■ ■ + 6„. For all -u e W, for i = 1, . . . , k, 

we have 



Since oi + ■ ■ ■ + a„ = 6i H h &„, for all s g 5", it must be that, for all u eU, 



^^M(s,o)a(s)(o) > ^^u{s,o)b{s){o) 



(2) 





n 



n 



i=l s£S i=l S&S 
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Thus, for all u eU, 

n n 
i=k+l s&S i=k+l sGS 

Since a^+i = . . . = a„ and bk+i = . . . = 6„, it easily follows that, for all u e U, 

ses ses 

Thus 6„ ^ a„, as desired. The fact that A3 holds is straightforward, and left to the 
reader. 

For the 'if direction, recall that we can view the elements of C as vectors in 
j^|s X o pq,. ^f^g ,.gg^ Qf ^f^jg proof, we identify elements of C with such vectors. Let 
D = {a - b : a,b e C}, and let = {a - b : b}. Recall that a (pointed) cone 
in rI^I^I*^! is a set CC that is closed under nonnegative linear combinations, so that 
if ci, C2 e CC and a, /3 > 0, then aci + /3c2 G CC. We need the following lemma. 

Lemma 1 . There exists a closed convex cone CC such that = CC n D. 



Proof. Let CC consist of all vectors of the form aidi + ■ ■ ■ + a„c?„ for some n > 
0, where di,...,dn G -D+ and ai, . . . , a„ > 0. Clearly CC is a convex cone, 
and closed because is finite. Also, C CC n For the opposite inclu- 
sion, suppose that aidi + ■ ■ ■ + = d, where di, . . . , rf„ e -D+, d e D, and 
> 0. Thus, there must exist ai, . . . , a„, 6i, . . . , 6„, a, 6 e C such that 
a — b = d, ai — bi = di, and Oj ^ 6j for i = 1, . . . , n. We want to show that d e -D+ 

or, equivalently, that a ^6. Letr = aiH hOn + l- Since C is mixture-closed, both 

(Q!i/r)aiH \-{an/r)an+{l/r)b G C and {ai/r)bi-\ h(a„/r)6„ + (l/r)a are in 

C. Moreover, since ai^iH ha„rf„ = c? and ^ 6j for i = 1, . . . , n, it easily follows 

from mixture independence (which is a consequence of extended mixture cancella- 
tion) that {ai/r)bi-\ h(a„/r)6„ + (l/r)a = (ai/r)aiH h (a„/r)a„ + (l/r)6 >z 

(l/r)6i H h (l/r)&„+ (l/r)6. Another application of mixture independence gives 

us a ^ 6, as desired. □ 

Returning to the proof of Theorem [HI note that if a ^ 6 for all a and b, then 
= D, and we can take CC to be the whole space. If y is nontrivial, then CC is 
not the whole space. It is well known (Rockafellar 1 970) that every closed cone that 
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is not the whole space is the intersection of closed half-spaces (where a half-space is 
characterized by a vector u such and consists of all the vectors x such that u-x >0). 
Given our identification of elements of C with vectors, we can identify the vector u in 
j^|s|x|o| characterizing a half-space with a (state-dependent) utility function, where 
u{s, o) is the (s, o) component of the vector u. If CC is the whole space, we can 
get a representation by simply taking U to consist of the single utility function such 
that u{s, o) = for all (s, o) e S x O. Othenwise, we can take U to consist of the 
utility functions characterizing the half-spaces containing CC. It is easy to see that 
for a,b e C, we have that a ^ 6 iff a - 6 g -D+ iff a - 6 e CC iff m ■ (a - 6) > for 
every half-space u containing CC; i.e. iff dU holds. □ 

To prove Theorem [8l the following lemma, which shows that we can identify 
complete preference orders with half-spaces, is also useful. Given a subset R of 
j^|s|x|o|^ define the relation '^n on C by taking a 6 iff a - 6 g -R. 

Lemma 2. EX^x = {hn- R is either a half-space containing CC or the full space}. 

Proof. If R is the full space, then is the trivial relation, so clearly g EXAxih)- 
If i? is a half-space H containing CC and H is characterized by u, then extends 
y, since CC C H. To see that satisfies Al, observe that if (a, 6) ^ ^h, then 
u ■ {a - h) < 0, so u ■ {b - a) > 0, and b cl. To see that satisfies A2', 
suppose that ai + ■ + a„ = 6i + ■ + 6„, and fei for z = 1, . . . , n — 1. Thus, 

M ■ («! H — h a„) = M ■ (6i + -bn), and m ■ (oj — fej) > for i = 1, . . . , n — 1. It follows 
that {bn - ttn) ■ u > 0, so bn ^n- Finally, for A3, it is clear that if (a„, 6„) (a, b), 
and u- {an - bn) > 0, then m ■ (a - 6) > 0, so a 6. Thus, G £'Xax(^)- 

For the opposite inclusion, suppose that ^'g EXAx{h)- Let CC" be the cone 
determined by y', as in LemmaQ] Clearly CC C CC'. If CC' is the full space, then 
we are done, since >z'=hcc'- Otherwise, CC is the intersection of half-spaces. 
Choose a half-space H such that CC c H. We claim that >z'=hH- Suppose not. 
Since CC C H, we must have y' C y^- There must exist a,b e C such that a^H b 
and a/^'6. Since ^' is complete, we must have b y' a. Thus, b cl, so a b. 
Since H is not the full space, there must be some c such that brjL^c. Suppose that 
c b. We must have cy b, since othenwise b y' c, and it follows that b c. By 
the Archimedean property (which holds by Proposition [7), since c y' b y' a, there 
existsr > Osuch that6 y' rc+{l—r)a. Thus we musthavefe yn rc+{l—r)a yn b. 
But this contradicts the assumption that c>~h b a. V\le get a similar contradiction 
\i b>~H c, since then ayn c. □ 



40 



Proof of Theorems m and |8]c. It is easy to check that if there is a constructive SEU 
representation of y, then y satisfies A21^ and A3. 

For the converse, suppose that y satisfies A2^ and A3. Take S = AtAx(Tb) 
and O' = Aq. Define ns{t) to be the set of all atoms 6 in AtAx(^o) such that 6 ^ t. 
Define p%o'i'^) to the constant function a for a primitive choice a. It is easy to see 
that pso'{ci) = fa for all choices a e C. Define a preference relation ^5 on the AA 
acts of the form pso'{o) by taking fa hs fb iff b. The fact that is well defined 
follows from Proposition [51 for if fa = fa', then it easily follows that a =ax a', so 
a ~ a'. Clearly satisfies extended statewise cancellation, and satisfies A1 iff y 
does. Thus, by Theorem [HI there is an additively separable representation of y. 

Now we adjust the state and outcome spaces to get a constructive SEU 
representation. Suppose first that A1 holds. Take S = AtAx(7o) and take O = 
AtAx(ro) X -4,0- For a primitive choice a e define P5o(a)(5) = {6, a). To com- 
plete the proof, it clearly suffices to find a probability measure p on AtAx(^o) and a 
utility function v on AtAx(^o) x ^0 such that u{6,a) = p{6)v{6,a), where u is the 
state-dependent utility function whose existence is guaranteed by Theorem [TH This 
is accomplished by taking any probability measure p on AtAx(^o) such that for all 
atoms 6, p{6) > 0, and taking v{6, a) = u{6, a)/p{5). 

If A1 does not hold, then proceed as above, using Theorem[i2]to get an entire 
set W of functions u : AtAx(^o) y- Aq ^ H, and a single probability distribution p 
that assigns positive probability to every atom. Let U consist of all utility functions 
u such that there exists some u' G W such that u{a,5) = u'{6,a)/p{6). In this 
representation, again, the state space is AtAx(To)- 

We now give a representation using a single utility function. Let S' = 

AtAxin) X EXAxih), and let O" = AtAx(To) x A x ^Aax(^). Define 
P5'0"(«)(^.^') = i^,cL,h')- Fort e To, define nsit) = 7rs{t) x EXAxih)- As 
before, let W be the set of utility functions on AtAx(^o) x Aq that represent y. 
Lemma [2] shows that W consists of one utility function uyi for every total order y'e 
EXAxih)- Again, fix a probability measure p on AtAx(To) such that p{6) > for all 
5 e AtAx(^o)- For each relation y'e EXax{>i), define p>-' on AtAx(^o) x EXax{>i) 
by taking p^'{S,y") = p{5) if y'=y", and p^'{5,y") = if y'^h". Let V = 
{Pt' '■'^'^ EXAxih)}- Dei\ne v{6,a,y') = uyi{6,a)/p{6). It is easy to see that 
V X {v} represents y. Moreover, it easily follows that, with this representation, 
and y © (a, b) can be represented by updating. □ 
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Now we show how the ideas in this proof can be modified to prove Theorems!!] 

andHt. 

Proof of Theorems m and |4]c. Again, it is easy to check that if there is a constructive 
SEU representation of ^, then >z satisfies A2'. 

For the converse, given a preference relation >z that satisfies A2'. The struc- 
ture of the proof is identical to that of Theorem [S] We first prove an analogue of 
Theorem [m 

Theorem 13. A preference relation ^on a set C of Savage acts mapping a finite set 
S of states to a finite set O of outcomes satisfies extended statewise cancellation iff 
there exists a setU of utility functions on S x O such that a^b iff 



Moreover, >z satisfies A1 iffU can be chosen to be a singleton. 

The proof of Theorem [T3] is identical to that of Theorem dH except that we 
need an analogue of Lemma [Hfor the case that ^ satisfies A2'. Let D and be 
defined as in LemmaQ] 

Lemma 3. /f ^ satisfies A2' There exists a cone CC such thatD^ = CC n D. 

Proof. Again, let CC consist of all vectors of the form aidi + ■ ■ ■ + for some 
n > 0, where di,...,dn e -D+ and ai, . . . , a„ > 0. Clearly CC is a cone. Since 
C is closed and bounded, so is D, and A3 implies that is closed and bounded. 
Therefore CC is closed. Furthermore, -D+ C CC n D. For the converse inclu- 
sion, suppose that aidi + ■ ■ ■ + = d, where di,..., d„ e -D+, d e D, and 
a„ > 0. That means that ai, . . . , a„ is a nonnegative solution to the system 
of equations xidi + ■ ■ ■ + Xndn = d. Since all the coefficients in these equations 
are rational (in fact, they are all 0, 1, and -1) there exists a nonnegative ratio- 
nal solution to this system of equations. It easily follows that there exist positive 
integers Pi,. . . ,Pn+i such that Pidi + ■ ■ ■ + = Pn+id- By definition, there 
must exist ai, . . . , a„, 6i, . . . , 6„, a, 6 G C such that a — b = d, at — bi = di, and 
ai ^ 6j for z = 1, . . . , n. It follows that {{ai, . . . , ai, . . . , a„, . . . , a„, 6, . . . , b}} = 
{{bi, . . . , 6i, . . . , a„, . . . , a„, 6, . . . , b}}, where occurs in the left-hand multiset Pi 
times and b occurs Pn+i times, and, similarly, bi occurs in the right-hand side Pi times 
and a occurs Pn+i times. A2' now implies that a y b, so d e CC, as desired. □ 




(3) 
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The proof of Theorem [TS] is now identical to that of Theorem [T2l IVIoreover, 
the proof of Theorem H] now follows from Theorem [Ts] in exactly the same way that 
the proof of Theorem [8]follows from Theorem [HI □ 

Proof of Theorems Ho] and Hole. First, let S = AtAx(To) and O' = Aq. As in the 
proof of Theorem [8l using Theorem [HI we can find an additively separable repre- 
sentation of ^; that is, we can find a set W of utility functions on S = AtAx(ro) x A 
that represent y. Let oi and oq denote the best and worst outcomes guaranteed to 
exist by A4. Note that it follows from A4 and A5 that u{6, oq) < u{6, a) < u{6, oi) 
for all {6, a) e S. (For null atoms 6, we must in fact have u{6, oq) = u{6, a) = u{6, oi) 
for all a e Aq)- Furthermore, note that we can replace u by u', where u'{6,a) = 
u{6, a) - u{6, Oq) for all (5, a) G 5 to get an equivalent representation; thus, by ap- 
propriate scaling, we can assume without loss of generality that, for all n g W, we 
have that u{6, oo) = for all 6 G AtAx(7o) (so u{6, a) > for all (5, a) G S) and 
that Y.5'eAtAx{Ta) ^^'(^'7 oi) = 1- Finally, note that it easily follows from A3 that, for 
all o G O, there exists a unique Co G [0, 1] such that o ~ CqOi + (1 - Co)oo (in fact, 
Co = inf {c : coi + (1 - c)oo h o}). Clearly = 1 and Co(, = 0. By A5, it follows that 
o ~5 CoOi + (1 - Co)oo for all atoms 6. Thus, we must have that u{6, o) = cou{6, oi) 
for all atoms 6 and all u e U. 

We now construct a state-independent SEU representation using O as the 
outcome space. Let S' = AtAx(To) x ^0 x EX^y^{y). Define vr^, by taking ngit) = 
Us^t{S X X EX^^{>:)}, and define pso{o.){{6,a' to be a if a G O; oi if 
a e Aq - O and a y'g a'; and oq otherwise. Let u' be defined by taking u'{o) = Co. 
Finally, recall that we can take U = >'g EX^^{>z)}, where uy> represents >z'. 
Let j9^' be defined so that p^/ (5, a, >i") = and, for all a G ^0, P>-'({(5, a', >z') : a >z' 
a'}) = U)^i{5, a). It is easy to check that a probability measure p^/ can be defined so 
as to satisfy this constraint. In particular, note thatp>-'({5} x^qX {^'}) = m>-'(5, oi). 
For all (5, a) G S, we have that 

uy,{5,a)= ^ 'pyi{5,a\t.') = ^ 'Py'{,5,a\t.')u{ps'o{.a){5,a\t.'))■ 
It follows that V and u represent ^, where V = {py' -.y'e EX^^{y)}. As usual, it 
is straightforward to verify that updating works appropriately. □ 
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